Thermodynamic limit from small lattices of coupled maps 
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We compare the behaviour of a small truncated coupled map lattice with random inputs at the 
boundaries with that of a large deterministic lattice essentially at the thermodynamic limit. We find 
exponential convergence for the probability density, predictability, power spectrum, and two-point 
correlation with increasing truncated lattice size. This suggests that spatio-temporal embedding 
techniques using local observations cannot detect the presence of spatial extent in such systems and 
hence they may equally well be modelled by a local low dimensional stochastically driven system. 
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Observation plays a fundamental role throughout all of 
physics. Until this century, it was generally believed that 
if one could make sufficiently accurate measurements of 
a classical system, then one could predict its future evo- 
lution for all time. However, the discovery of chaotic be- 
haviour over the last 100 years has led to the realisation 
that this was impractical and that there are fundamental 
limits to what one can deduce from finite amounts of ob- 
served data. One aspect of this is that high dimensional 
deterministic systems may in many circumstances be in- 
distinguishable from stochastic ones. In other words, if 
we have a physical process whose evolution is governed 
by a large number of variables, whose precise interac- 
tions are a priori unknown, then we may be unable to 
decide on the basis of observed data whether the system 
is fundamentally deterministic or not. This has led to 
an informal classification of dynamical systems into two 
categories: low dimensional deterministic systems and all 
the rest. In the case of the former, techniques developed 
over the last two decades allow the characterisation of 
the underlying dynamics from observed time series via 
quantities such as fractal dimensions, entropies and Lya- 
punov spectra ||l|. Furthermore, it is possible to predict 
and manipulate such time series in highly effective ways 
with no prior knowledge of the physical system gener- 
ating the data. In the case of high dimensional and/or 
stochastic systems, on the other hand, relatively little 
is known about what information can be extracted from 
observed data, and this topic is currently the subject of 
intense research. 

Many high dimensional systems have a spatial extent 
and can best be viewed as a collection of subsystems at 
different spatial locations coupled together. The main aim 
of this letter is to demonstrate that using data observed 
from a limited spatial region we may be unable to distin- 
guish such an extended spatio-temporal system from a 
local low dimensional system driven by noise. Since the 
latter is much simpler, it may in many cases provide a 
preferable model of the observed data. On one hand this 
suggests that efforts to reconstruct by time delay embed- 



ding the spatio-temporal dynamics of extended systems 
may be misplaced, and we should instead focus on devel- 
oping methods to locally embed observed data. A prelim- 
inary framework for this is described in |Q . On the other 
hand, these results may help to explain why time delay 
reconstruction methods sometimes work surprisingly well 
on data generated by high dimensional spatio-temporal 
systems, where a priori they ought to fail: in effect such 
methods only see a "noisy" local system, and providing a 
reasonably low "noise level" can still perform adequately. 
Overall we see that we add a third category to the above 
informal classification: namely that of low dimensional 
systems driven by noise and we need to adapt our recon- 
struction approach to take account of this. 

We present our results in the context of coupled map 
lattices (CML's) which are a popular and convenient 
paradigm for studying spatio-temporal behaviour |^ . In 
particular, consider a one-dimensional array of diffusively 
coupled logistic maps: 



{^-e)f{xl) + -{f{xl,) + f{xl^,)), (1) 



where x* denotes the discrete time dynamics at discrete 
locations z = 1, . . . , L, e G [0, 1] is the coupling strength 
and the local map / is the fully chaotic logistic map 
f{x) = Ax{l — x). Recent research has focused on the 
thermodynamic limit, L — > cxd, of such dynamical sys- 
tems Many interesting phenomena arise in this limit, 
including the rescaling of the Lyapunov spectrum and 
the linear increase in Lyapunov dimension . The physi- 
cal interpretation of such phenomena is that a long array 
of coupled systems may be thought of as a concatena- 
tion of small-size sub-systems that evolve almost inde- 
pendently from each other Q. As a consequence, the 
limiting behaviour of an infinite lattice is extremely well 
approximated by finite lattices of quite modest size. In 
our numerical work, we thus approximate the thermody- 
namic limit by a lattice of size L = 100 with periodic 
boundary conditions. 

Numerical evidence |^ suggests that the attractor in 
such a system is high-dimensional (Lyapunov dimension 
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approximately 70). If working with observed data it is 
clearly not feasible to use an embedding dimension of 
that order of magnitude. On the other hand, it is pos- 
sible ||] to make quite reasonable predictions of the evo- 
lution of a site using embedding dimensions as small as 
4. This suggests that a significant part of the dynam- 
ics is concentrated in only a few degrees of freedom and 
that a low dimensional model may prove to be a good 
approximation of the dynamics at a single site. In order 
to investigate this we introduce the following truncated 
lattice. Let us take N sites {i = 1, . . . ,N) coupled as 
in equation and consider the dynamics at the bound- 
aries Xq and x^^j^ to be produced by two independent 
driving inputs. The driving input is chosen to be white 
noise uniformly distributed in the interval [0, 1]. We are 
interested in comparing the dynamics of the truncated 
lattice to the thermodynamic limit case. 
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FIG. 1. Distance between (a) the probability density and 

(b) the power spectra in the thermodynamic limit and its 

truncated lattice counterpart as the number of sites A'' in the 

latter is increased. 

We begin the comparison between the two lattices by 
examining their respective invariant probability density 
at the central site (if the number of sites is even, either of 
the two central sites is equivalent). For a semi-analytic 
treatment of the probability density of large arrays of 
coupled logistic maps see Lemaitre et al. Let us de- 
note by poo{x) the single site probability density in the 
thermodynamic limit and pn{x) the central site prob- 
ability density of the truncated lattice of size TV. We 
compare the two densities in the Ci norm by computing 

Ap(7V)= / \p^{x) ^ pN{x)\dx (2) 
Jo 

for increasing N . The results are summarised in figure 
|l|.a where log(Ap(7V)) is plotted for increasing N for dif- 
ferent values of the coupling. The figure suggests that the 
difference between the densities decays exponentially as 
N is increased (see straight lines for guidance). Similar 
results were obtained for intermediate values of the cou- 
pling parameter. The densities used to obtain the plots 
in figure ^.a were estimated by a box counting algorithm 
by using 100 boxes and 10^ points (10^ different orbits 



with 10^ iterations each). The maximum resolution typ- 
ically achieved by using these values turns to be around 
Ap{N) ~ exp(— 6.5) ~ 0.0015. This explains the satura- 
tion of the distance corresponding to e = 0.2. For e = 0.8 
the saturation would occur for approximately N = 30, 35 
given enough computing power (more refined boxes and 
more iterations). Nonetheless, densities separated by a 
distance of approximately exp(— 3) ~ 0.05 (see horizon- 
tal threshold in figure |l|.a), or less, capture almost all 
the structure. Therefore, one recovers the essence of the 
thermodynamic limit probability density with a reason- 
able small truncated lattice (see figures |[a,b). 
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FIG. 2. Approximating (a,b) the probability density and 
(c,d) the power spectra of the thermodynamic limit (thick 
lines) using a truncated lattice (thin lines). 



Next we compare temporal correlations in the trun- 
cated lattice with those in the full system. Denote by 
Soa{^) the power spectrum of the thermodynamic limit 
and 5Ar(cL;) its counterpart for the truncated lattice. Fig- 
ure 0.b shows the difference AS{T) in the Ci norm be- 
tween the power spectra of the truncated lattice and of 
the thermodynamic limit for s = 0.2 and 0.8 (similar re- 
sults were obtained for intermediate values of e). As for 
the probability density, the power spectra appear to con- 
verge exponentially with the truncated lattice size. Note 
that for large N, particularly for small e, the difference 
tends to saturate around exp(— 12) « 10^^, this is be- 
cause the accuracy of our power spectra computations 
reaches its limit (with more iterations one can reduce 
the effects of the saturation). Our results were obtained 
by averaging 10^ spectra (|DFTp) of 1024 points each. 
In figures |[c,d we depict the comparison between the 
spectra corresponding to the thermodynamic limit and 
to the truncated lattice. As can be observed from the 
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figure, the spectra for the truncated lattice give a good 
approximation to the thermodynamic limit. It is worth 
mentioning that the spectra depicted in figures ^.c,d are 
plotted in logarithmic scale so to artificially enhance the 
discrepancy of the distance between the thermodynamic 
limit and the truncated lattice. The distance correspond- 
ing to these plots lies well below AS{T) < exp(— 7.5) w 
5 X 10~^. The convergence of the power spectrum is much 
faster than the one for the probability density (compare 
both scales in figures Wj. 
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FIG. 3. Difference of the two-point correlation between the 

truncated lattice and the thermodynamic limit for two neigh- 
bours at the same iteration (C(f = 1, r = 0)). 

To complete the comparison picture we compute the 
two-point correlation |^] 



where u = and v 



{uv) — {u){v) 

(w2)_(u)2 ■ 



(3) 



Thus, C(^,t) corresponds 
to the correlation of two points in the lattice dynamics 
separated by ^ sites and r time steps. To obtain the two- 
point correlation for the truncated lattice we consider the 
two points closest to the central site separated by ^. We 
then compute AC^^ri^) defined as the absolute value of 
the difference of the correlation in the thermodynamic 
limit with that obtained using the truncated lattice of 
size N. In figure ^ we plot ACi_o(-^) as a function of N 
for e = 0.2 and 0.8. For e = 0.2, due to hmited accu- 
racy of our calculations, the saturation is reached around 
N — 10. Nonetheless it is possible to observe an exponen- 
tial decrease (straight lines in the linear-log plot) before 
the saturation. For larger values of e the exponential con- 
vergence is more evident (see figure §.b). Similar results 
were obtained for intermediate e-values. Note that be- 
cause the correlation oscillates, it is not possible to have 
a point by point exponential decay for ACi^o(-^), how- 
ever, the upper envelope clearly follows an exponential 
decay (see straight lines for guidance). Similar results 
were obtained for different values of (^,r). 

The above comparisons were carried out by using the 
data produced by the known system (pi). Often, in prac- 



tice, one is deprived of the evolution laws of the sys- 
tem. In such cases, the only way to analyse the system 
is by using time series reconstruction techniques. This is 
particularly appropriate when dealing with real spatio- 
temporal systems where, typically, only a fraction of the 
set of variables can be measured or when the dynamics 
is only indirectly observed by means of a scalar measure- 
ment function. In the following we suppose that the only 
available data is provided by the time series of a set of 
variables in a small spatial region. We would like to study 
the effects on predictability when using a truncated lat- 
tice instead of the thermodynamic limit. 
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ds = 2,dt = l^^ 
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FIG. 4. Normalised one-step prediction error difference (H) 

between a truncated lattice and the thermodynamic limit 

for two spatio-temporal embeddings {{ds,dt) = (2,1) and 

{ds,dt) = (2,2)) and different couplings strengths. 

Instead of limiting ourselves to onc-dimcnsional time- 
series (temporal embedding) we use a mix of temporal 
and spatial delay embeddings (spatio-temporal embed- 
ding) 0. Therefore we use the delay map 



whose entries y* 



,X 



t-(dt-l) 



(4) 



) are time- 



delay vectors and where ds and dt denote the spatial 
and temporal embedding dimensions. The overall em- 
bedding dimension is d = dgdt. The delay map (^) is 
used to predict a;*'*'^. Note that we are using spatial 
coordinates only from the left of a;*"*"^ (i.e. a;'- such that 
j < «)• An obvious choice of spatio-temporal delay would 



be a symmetric one such as Xi 



_i,a;-,a;*+i). How- 



ever, this would give artificially good results (for both 
the full and truncated lattices) since x*'^^ depends only 
on these variables (cf. (|l|)). This is an artefact of the 
choice of coupling and observable and could not be ex- 
pected to hold in general. Therefore, we use the delay 
map (^) in order to "hide" some dynamical information 
affecting the future state and hence make the prediction 
problem a non-trivial one. The best one-step predictions 
Q using the delay map (^ are typically obtained for 
ds — dt — 2. Here we use the two cases {ds,dt) — (2, 1) 
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and {ds, dt) = (2, 2); almost identical results are obtained 
for higher dimensional embeddings {{ds,dt) G [1,4]^). 
Denote by E{N) the normalised root-mean square er- 
ror for the one step prediction using the delay map (^) 
at the central portion of the truncated lattice of size N. 
The comparison between E{N) and E{N — * oo) is shown 
in figure ^ where we plot the absolute value of the nor- 
malised error difference 



AE{N) = \{E{N) - E{oo))/E{oo)\ 



(5) 



for increasing N and for different spatio-temporal em- 
beddings and coupling strengths. The figure shows a 
rapid decay of the prediction error difference for small 
N and then a saturation region where the limited accu- 
racy of our computation hinders any further decay. For 
e = 0.2 the drop to the saturation region is almost im- 
mediate while for the large coupling value £ = 0.8 the 
decay is slow enough to observe an apparently exponen- 
tial decay (see fitted line corresponding to ds = dt = 2 
for N = 1,...,20), thereafter the saturation region is 
again reached. For intermediate values of e, the satu- 
ration region is reached between N = 5 and 20 (results 
not shown here). Before this saturation it is possible to 
observe a rapid (exponential) decrease of the normalised 
error difference. This corroborates again the fact that it 
seems impossible in practice to differentiate between the 
dynamics of the relatively small truncated lattice and the 
thermodynamic limit. 

All the results in this letter where obtained from the 
simulation of a truncated lattice with white noise inputs 
at the boundaries. Other kinds of inputs did not change 
our observations in a qualitative way. It is worth men- 
tioning that a truncated lattice with random inputs with 
the same probability density as the thermodynamic limit 
(fooix)) produces approximatively the same exponential 
decays as above with just a downward vertical shift (i.e. 
same decay but smaller initial difference). 

The properties of the thermodynamic limit of a coupled 
logistic lattice we considered here (probability densities, 
power spectra, two-point correlations and predictabil- 
ity) were approximated remarkably well (exponentially 
close) by a truncated lattice with random inputs. There- 
fore, when observing data from a limited spatial region, 
given a finite accuracy in the computations and a reason- 
ably small truncated lattice size, it would be impossible 
to discern any dynamical difference between the ther- 
modynamic limit lattice and its truncated counterpart. 
The implications from a spatio-temporal systems time se- 
ries perspective are quite strong and discouraging: even 
though in theory one should be able to reconstruct the 
dynamics of the whole attractor of a spatio-temporal sys- 
tem from a local time series (Takens theorem [0), it ap- 
pears that due to the limited accuracy (CPU precision, 
time and memory limitations, measurement errors, lim- 
ited amount of data) it would be impossible to test for 
definite high-dimensional determinism in practice. 



The evidence presented here suggests the impossibility 
of reconstructing the state of the whole lattice from lo- 
calised information. It is natural to ask whether we can 
do any better by observing the lattice at many (possibly 
all) different sites. Whilst in principle this would yield 
an embedding of the whole high-dimensional system, it 
is unlikely to be much more useful in practice. This is 
because the resulting embedding space will be extremely 
high dimensional and any attempt to characterise the dy- 
namics, or fit a model will suffer from the usual "curse 
of high dimensionality" . In particular, with any realistic 
amount of data, it will be very rare for typical points to 
have close neighbours. Hence, for instance, predictions 
are unlikely to be much better than those obtained from 
just observing a localised part of the lattice. 

If one actually wants to predict the behaviour at many 
or all sites, our results suggest that the best approach is 
to treat the data as coming from a number of uncoupled 
small noisy systems rather than a single large sys- 
tem. Of course, if one has good reason to suppose that 
the system is spatially homogeneous, one should fit the 
same local model at all spatial locations, thereby sub- 
stantially increasing the amount of available data. 
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